Light-weight pixel context encoders for image inpainting

نویسندگان

  • Nanne van Noord
  • Eric O. Postma
چکیده

In this work we propose Pixel Content Encoders (PCE), a lightweight image inpainting model, capable of generating novel content for large missing regions in images. Unlike previously presented convolutional neural network based models, our PCE model has an order of magnitude fewer trainable parameters. Moreover, by incorporating dilated convolutions we are able to preserve fine grained spatial information, achieving state-of-the-art performance on benchmark datasets of natural images and paintings. Besides image inpainting, we show that without changing the architecture, PCE can be used for image extrapolation, generating novel content beyond existing image boundaries.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Beam Search for Top - B Decoding in Bi - RNNs Deep Learning Summer School , Montreal , CA

Wepresent an unsupervised visual featurelearning algorithm driven by context-based pixel prediction. By analogy with auto-encoders, we propose Context Encoders– a convolutional neural network trained to generate the contents of an arbitrary image region conditioned on its surroundings. In order to succeed at this task, context encoders need to both understand the content of the entire image, as...

متن کامل

Structural inpainting

Scene-agnostic visual inpainting remains very challenging despite progress in patch-based methods. Recently, Pathak et al. [25] have introduced convolutional “context encoders” (CEs) for unsupervised feature learning through image completion tasks. With the additional help of adversarial training, CEs turned out to be a promising tool to complete complex structures in real inpainting problems. ...

متن کامل

Improving Exemplar-based Image Completion methods using Selecting the Optimal Patch

Image completion is one of the subjects in image and video processing which deals with restoration of and filling in damaged regions of images using correct regions. Exemplar-based image completion methods give more pleasant results than pixel-based approaches. In this paper, a new algorithm is proposed to find the most suitable patch in order to fill in the damaged parts. This patch selection ...

متن کامل

A Survey on Image Inpainting for Remotely Sensed Images

Image inpainting is the process of reconstructing an image or to fill the missed region by using the surrounding pixels so that it looks reasonable to human eye. Sometimes, while capturing the image dead pixels will exists in the image which results in degraded image. In this paper, various algorithms are discussed by using which we can get a smoothed and undegraded image. Keywords—Inpainting, ...

متن کامل

Image Inpainting using Block-wise Procedural Training with Annealed Adversarial Counterpar

Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow or generate unsatisfying results with easily detectable flaws. In addition, there is often perceivable discontinuity near the holes and require further post-p...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1801.05585  شماره 

صفحات  -

تاریخ انتشار 2018